Hebbian and error-correction learning for complex-valued neurons

نویسنده

  • Igor N. Aizenberg
چکیده

In this paper, we observe some important aspects of Hebbian and error-correction learning rules for complex-valued neurons. These learning rules, which were previously considered for the multi-valued neuron whose inputs and output are located on the unit circle, are generalized for a complex-valued neuron whose inputs and output are arbitrary complex numbers. The Hebbian learning rule is also considered for the multi-valued neuron with a periodic activation function. It is experimentally shown that Hebbian weights, even if they still cannot implement an input/output mapping to be learned, are better starting weights for the error-correction learning, which converges faster starting from the Hebbian weights rather than from the random ones.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Nonlinear Complex-Valued Extensions of Hebbian Learning: An Essay

The Hebbian paradigm is perhaps the best-known unsupervised learning theory in connectionism. It has inspired wide research activity in the artificial neural network field because it embodies some interesting properties such as locality and the capability of being applicable to the basic weight-and-sum structure of neuron models. The plain Hebbian principle, however, also presents some inherent...

متن کامل

A Multi-valued Neuron with a Periodic Activation Function

In this paper, a new activation function for the multi-valued neuron (MVN) is presented. The MVN is a neuron with complex-valued weights and inputs/output, which are located on the unit circle. Although the MVN has a greater functionality than a sigmoidal or radial basis function neurons, it has a limited capability of learning highly nonlinear functions. A periodic activation function, which i...

متن کامل

Multilayer Feedforward Neural Network Based on Multi-valued Neurons (MLMVN) and a Backpropagation Learning Algorithm

A multilayer neural network based on multi-valued neurons is considered in the paper. A multivalued neuron (MVN) is based on the principles of multiple-valued threshold logic over the field of the complex numbers. The most important properties of MVN are: the complex-valued weights, inputs and output coded by the k roots of unity and the activation function, which maps the complex plane into th...

متن کامل

Unsupervised Classification of Complex Clusters in Networks of Spiking Neurons

For unsupervised clustering in a network of spiking neurons we develop a temporal encoding of continuously valued data to obtain arbitrary clustering capacity and precision with an efficient use of neurons. Input variables are encoded independently in a population code by neurons with 1-dimensional graded and overlapping sensitivity profiles. Using a temporal Hebbian learning rule, the network ...

متن کامل

Spiking Neurons by Sparse Temporal Coding and Multilayer Rbf Networks

We demonstrate that spiking neural networks encoding information in the timing of single spikes are capable of computing and learning clusters from realistic data. We show how a spiking neural network based on spike-time coding and Hebbian learning can successfully perform unsupervised clustering on real-world data, and we demonstrate how temporal synchrony in a multi-layer network can induce h...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Soft Comput.

دوره 17  شماره 

صفحات  -

تاریخ انتشار 2013